Second law of thermodynamics and irreversibility in quantum systems 
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We test Boltzmann's H-theorem for several models of particle random walk. We study the in- 
fluence of interaction between the particle and reservoir/detectors on entropy and find entropy 
increasing in time for some models and behaving non-monotonically for others. The key mechanism 
affecting the entropy growth is the quantum entanglement between the system and the reservoir. 
We discuss the details of the system-reservoir interaction, such as presence of the interference in 
the system and number of interactions with detector parts, and their impact on the monotonicity 
of entropy. 
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Introduction. The second law of thermodynamics is 
the fundamental law of nature [1]. One of its well-known 
formulations assumes the existence of state function (en- 
tropy), which does not decrease for isolated thermody- 
namic systems. This formulation implies the irreversibil- 
ity in thermodynamic systems. At low temperatures 
quantum nature manifests itself [2, 3] and the second 
law of the thermodynamics may not necessarily work in 
its classical formulation. For example, let us consider 
a standalone quantum system and define the entropy S 
according to von Neumann S = — Tr{/51og p}, where p 
is the density matrix of the system. In this case the 
entropy of this system neither increases nor decreases, 
but remains constant [4]. Then the question arises: what 
kind of non-isolated quantum systems reveals the entropy 
growth and what is the mechanism of this behavior from 
the quantum mechanical point of view? 

This question is particularly relevant for the quan- 
tum thermodynamics in small systems. Some of them 
were considered in Refs. [9-14]. Recently several articles 
have been published [5-8] , where entropy growth was dis- 
cussed from the quantum mechanical point of view. In 
these articles the key qualitative point is the entangle- 
ment between the system and the reservoir. Moreover, 
there is a quantitative statement, that small subsystem 
interacting with the large quantum system obeys the en- 
tropy growth in the majority number of cases, made in 
Refs. [5, 6]. Later the same authors have found that the 
small subsystem does not necessarily relax to the equi- 
librium state [7], hence the deviation from the standard 
thermodynamic behavior is implied. Thus, it remains un- 
clear what types of reservoirs provide the entropy growth. 

However, there is no doubt that during the interaction 
the energy exchange (heat exchange in terms of thermo- 
dynamics) should be infinitesimally small. Otherwise the 
entropy can either increase or decrease depending on the 
heat flux. 

In this Letter we discuss a random walk of a quantum 



particle, which in some cases can be described by the 
kinetic (master) equation, but in some other cases can 
be not. We study several model systems interacting with 
reservoirs (see Fig. 1) and determine the condition for the 
entropy growth. We focus on the two important features 
possibly causing the deviation from the kinetic equation. 

The first feature is the quantum interference in the sys- 
tem. Usually the entropy of non-coherent systems tends 
to grow with time. However, coherent systems with inter- 
ference [see Fig. 1(c)] can not be described by the master 
equation for probabilities and the H-theorem [15] is not 
directly applicable for such systems. Therefore, in prin- 
ciple the quantum interference might lead to the entropy 
decrease during some special interactions with the reser- 
voir. 

Another source of the entropy decrease is the multiple 
interactions with the reservoir, see Fig. 1(d). This situa- 
tion is quite special: usually only single interaction with 
the reservoir occurs, e.g., photons (phonons) after inter- 
acting with a system disappear in the reservoir and/or 
lose coherence. In case of multiple interactions the "work- 



fa) 



(b) 



(c) 



(d) 



Unitary 
evolution 



Single 
interaction 



Interference 



Multiple 
interaction 



FIG. 1: Quantum mechanical system (green) connected to 
the reservoir (red). System evolution is schematically shown 
by green arrows. For clarity the reservoir is divided into sev- 
eral independent parts. The interaction is marked by a dashed 
line, (a) Non-interacting system evolves unitarily and its en- 
tropy does not change, (b) "Single shot" interaction: the 
system interacts with a new part of the reservoir at every 
step, (c) System can interfere with itself, (d) System can 
interact with some parts of the reservoir several times. 
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ing" parts of the reservoir should be in the vicinity of the 
system all the time. To comply with these requirements 
we consider one-dimensional system equipped by an ar- 
ray of spins acting as a reservoir in this Letter. 

Technically, we use the scattering matrix approach for 
a random walk of a quantum particle [16]. In contrast to 
the classical random walk, the master equation for prob- 
abilities can not be used in this case. Note that random 
walk of a quantum particle described here differs from the 
so called quantum random walk [17, 18], where tunneling 
probabilities depend on the state of extra degree of free- 
dom; in our case dependence is due to the phase differ- 
ence accumulating over different Feynman paths (particle 
trajectories) only. First we describe the one-dimensional 
system with scatterers and spins located along this sys- 
tem. The electron can be transmitted or reflected on 
scatterers keeping phase coherence and rotates each spin 
when passing it. We observe the evolution of the system 
state in discrete time and found the entropy sometimes 
decreases during some specific interactions with the reser- 
voir. The second system we consider is a binomial tree 
system with no back reflection from beam splitters on 
the nodes. An electron enters to the root, is split in half 
for each node, and acts on the new spin each next step. 
There is no interference in this system and it interacts 
with a given part of the reservoir (given spin) just once. 
Expectedly, the entropy of this system monotonically in- 
creases in time. In the case of complete phase breaking 
after each step (e.g., each spin rotates by ir) the system 
can be described by a kinetic equation and the H-theorem 
can be proven explicitly. The third system demonstrates 
an intermediate case. It is a tree-like system with inter- 
ference and single interaction with reservoir parts. 

Quantum one- dimensional walk. Let us consider an 
ideal one-dimensional wire with equivalent scatterers lo- 
cated at equal distances from each other, see Fig. 2(a). 
Each scatterer has a transmission amplitude t and reflec- 
tion amplitude r. We assume non-smearing wave package 
(electron) moving with fixed speed and introduce discrete 
time r enumerating the moments when the wave package 
is located exactly between two neighbor scatterers. 

The reservoir is presented by spins located at scat- 
terers. Two possible processes at the first scatterer are 
shown in Fig. 2(a). Initially (r = 0) the electron is lo- 
cated exactly between two scatterers (i = 0) and moves to 
the right. At the first step (r = 1) the reflected electron is 
located at the same position and moving left (with proba- 
bility R = 1— T = |r| 2 ), whereas the transmitted electron 
is located right to the initial position and moving right 
(with probability T = \t\ 2 ). The system-reservoir interac- 
tion is given by spin rotating by some certain angle when 
the electron passes through the scatterer and remaining 
in the same state if the electron is reflected from the scat- 
terer. For simplicity this angle is chosen to be tt. In this 
case the array of spins "traces" the electron position, but 
does not remember the history of its movements. Per- 
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FIG. 2: (a) One-dimensional system with scatterers (crosses) 
with transmission and reflection amplitudes t and r. Electron 
(green dot) starts to move right at position i = between 
scatterers and r = 0. Each spin (red arrow) rotates by n 
when electron moves near it. Two possibilities at r — 1 are 
shown: transmitted electron moved near spin once and have 
rotated it, while reflected electron formally moved near spin 
even (0 or 2) times and have left it in the same position. 

(b) Entropy of one-dimensional model as a function of time r 
ft = VT, r = VI - T, and T = 0.4) monotonically increases 
"in average". Small insets show the non-monotonic behavior 
between some steps, e.g., r = 2-3, 7-8, 41-42, 55-56, etc. 

(c) First step r followed by entropy drop plotted as a function 
of transparency T = \t\ 2 . (d) Entropy as a function of r 
for several spins symmetrically located at and around first 
scatterer [center cross in Fig. (a)]. 



forming this procedure at the next steps we obtain a set 
of probabilities {P[*(t)} ({-P^(t)}) to observe the elec- 
tron at position i moving right (left). The probability to 
find the particle at position i is Pj(r) = P[*(t) +P^~(t). 
Note that due to the chosen initial conditions, P£~{t) = 
if i + t is even, P^(t) = if i + t is odd. Therefore, 
Pi (r) is defined only by the electron moving right or left 
and never by its superposition. 

In this simple model the density matrix p c = Tr s {/5} 
of the electron subsystem (the whole density matrix p 
traced over spin degrees of freedom) is already diagonal, 
p e = diag{Po, Pit ■ ■ •}• This allows us to immediately 
find the von Neumann entropy S = — J2i Pi l°g Pi ■ The 
entropy as a function of discrete time (steps) r is shown 
in Fig. 2(b) for T = 0.4. In average the entropy loga- 
rithmically increases in time, S(t) cx log r (system pa- 
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ramcters, such as transmission amplitude t, can slightly 
change the dependence). The system is strongly mixed 
and the entropy is close to its possible maximum. On the 
other hand at some steps the entropy decreases, which 
demonstrates impossibility to extend H-theorem for such 
models. Figure 2(c) shows the first time step r followed 
by entropy decrease as a function of transmission prob- 
ability T. For example, the first entropy drop occurs 
between 2 nd and 3 rd steps at T g [0.35 . . . 0.50], between 
3 rd and 4 th steps at T g [0.58 . . .0.71], and between 4 th 
and 5 th steps at T g [0.72 . . . 0.80]. 

Here the electron and spin subsystems are treated as a 
system and reservoir respectively, see Fig. 1. Note, since 
the whole system is pure, the entropies of the electron and 
spin subsystems are equal and therefore it is possible to 
present the electron subsystem as a reservoir. 

Another important example we consider is one- 
dimensional motion with several spins. To be specific, 
we take odd number of spins symmetrically located at 
and around first scatterer. The entropy as a function of 
time r is presented in Fig. 2(d) for 1, 3, 5, and 7 spins. In 
the absence of spins the evolution is unitary and entropy 
remains zero. In the presence of all spins the entropy in- 
creases logarithmically in average as before (black line). 
In case of several spins the entropy behaves exactly as in 
the case of all spins at small r and saturates at constant 
value ^ = Pl log Pl + Pr log Pr at large r, where Pl 
and Pr are probabilities to observe particle at the left and 
at the right from the set of several spins (Pl + Pr = 1). 

Binomial tree without interference. Let us consider a 
tree with scattcrcrs at the nodes and ideally conducting 
edges as shown in Fig. 3(a). Each scatterer splits the 
incoming wave packet to the two outgoing wave pack- 
ets without backscattering. It can be described by 3 x 3 
scattering matrix with "transmission" t = y/T (incom- 
ing to the first outgoing) and "reflection" r = i\J\ — T 
(incoming to the second outgoing) amplitudes. 

We again assume no wave packet spreading and intro- 
duce discrete time r. At r = the wave packet enters 
to the root edge, at r = 1 the wave packet is split once 
and two resulting wave packets are located at the next 
two edges, at r = 2 the wave packets are located at four 
edges, and so on. 

In this model the reservoir/detectors are presented by 
spins at the edges. The spin rotates by some certain an- 
gle <p while electron is moving through this edge. We 
enumerate the spins in the following way: two spins xo 
and xi are located after the first splitter; four spins xoo, 
Xoi- XiOj arid xn after the next two splitters, etc. At the 
beginning, all spins are in some initial state XC,ij which 
becomes xc,f after rotating by the angle <p, where ( is the 
r-digit spin index (C = 0, 1, 00, 01, 10, 11, . . .). The spin 
index contain all information about electron path, e.g., 
£ = 010 corresponds to the electron path — > 1 — > 0. We 
introduce a phenomenological constant (xc.fxj i) = Q S 
the same for all spins. It may also serve, e.g., for ap- 
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FIG. 3: (a) Tree-like model setup without interference. The 
beam splitters without back reflection are located at all nodes. 
Particle can penetrate to lower or upper arm with 50/50 prob- 
ability and can not be reflected back. Spins are located on 
each edge and rotate by some certain angle when electron 
moves through this edge. State of spins' subsystem has one- 
to-one correspondence to the electron path, e.g., spin at po- 
sition with index \ = 10 corresponds to the electron path 
shown in green arrows, (b) Entropy as a function of time r 
for tree model without interference and Z = 2 monotonically 
increases in time. 



proximate description of decohcrence due to the breaking 



radiation. 



Naturally, (xc.iX^i) = (Xf.fXc'.f) = S ' 



and 



(xcax[> f ) = a $CC . The density matrix can be expressed 
in terms of ota* , thus we will use j3 = aa* as a braking 
radiation parameter below. 

Wave function of the electron and spin subsystems de- 
fines state of the system. Using this wave function we 
calculate the density matrix then take the trace over the 
spin degrees of freedom, which results in r x r electron 
density matrix at r step. The entropy for double output 
splitters (Z = 2) and T = 0.5 as a function of r is shown 
in Fig. 3(b). It monotonically increases in time, thus we 
would like to claim that the H-theorem can be broadened 
to quantum systems without interference and with single 
system-reservoir interaction, though the density matrix 
of these systems is non-diagonal in contrast to the ki- 
netic equation case. We have tested it for different /3's, 
different number of splitter outputs Z > 2, and different 
transmission amplitudes of each beam splitter (keeping 
its unitarity) . Also we considered different models of tree 
without interference, e.g., model where only one channel 
splits at every step. The qualitative result is the same: 
entropy monotonically increases with t. 

The entropy growth occurs due to the increasing en- 
tanglement with the spin subsystem acting as a reser- 
voir. The details depend on how new degrees of freedom 
comes into play: roughly, quicker entanglement leads to 
faster entropy growth. In the case of complete phase 
breaking after the system density matrix becomes di- 
agonal. It diagonal elements obey the master equation 
and satisfy the H-theorem conditions. The keynote is 
the splitting of probability P at step r into two parts 
with probabilities Pi and P2 = P — P\ at step r + 1. 
The entropy of the corresponding part is non-decreasing 
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s(r+l) = -Pi log P 1 -P 2 log P 2 ^ -Pi log P-P 2 log P = 
— PlogP = s(t), thus the total entropy is also non- 
decreasing. 

Binomial tree with interference. Now let us consider 
an intermediate case. The system with interference can 
interact with a given spin only once. We define a tree 
as shown in Fig. 4(a). Each beam splitter has two in- 
puts and two outputs and is back-reflection-less. Electron 
keeps the direction of motion (transmits) with amplitude 
t = VT and turns (reflects) with amplitude r = i\J\ — T. 
The particle can reach a given position by different paths, 
e.g., in order to reach link 2 at r = 3 it can move through 
link 1 at r = 1 and link 2 at t = 2 (solid green arrows) 
or, alternatively, through link at r = 1 and link 1 at 
r = 2 (dotted green arrows). The state of electron sub- 
system is defined by the 2r length vector at r th step. The 
links can be enumerated by index £ (= r, j), where j goes 
from to 2t — 1. In contrast to the previous model, the 
electron path for a given index £ is indistinguishable. As 
before we place the spin at each link. It can rotate by 
some certain angle whenever the electron moves through 
correspondent link. Thereby, spin subsystem stores in- 
formation about the electron path (which in principle 
can be measured later). Two electron paths marked by 
rotated spins are depicted in Fig. 4(a) in solid and dot- 
ted red arrows. In this case the system can be described 
by 2 r possible states as in the case without interference. 

Present model is equivalent to the system with a one- 
dimensional electron and spin sets shown in Fig. 4(b). 
The latter recalls the very first model in Fig. 3(a), how- 
ever the spin set is replaced by the new one (in the initial 
state) after each step. In this setup the electron can inter- 
act with each spin only once and can interfere with itself. 
Figure 4(c) shows the entropy as a function of time for 
beam splitter transmission probability T = 0.5 and dif- 
ferent /3's. The same function for different transmission 
probabilities T and /? = 0.9 is shown in Fig. 4(d). The 
entropy is strictly growing in time. Introducing the inter- 
ference in the system, which can interact with reservoir 
part only once does not break validity of H-theorem state- 
ment. Note, when moving electron rotates spin by ir (full 
phase breaking case) the electron subsystem can be de- 
scribed by the master equation for probabilities and one 
can prove H-thcorem analytically in the spirit of Boltz- 
mann. 

Conclusion. In this Letter we discussed several mod- 
els of the random walk of the particle entangled with 
auxiliary system of spins. In the models with full phase 
breaking coming from the spin subsystem one can derive 
master equation for probabilities and, thus, prove the 
H-theorem explicitly. However, more complicated mod- 
els with partial phase breaking can not be described by 
master equation for probabilities. The H-theorem state- 
ment still valid for some of them and becomes invalid for 
the others. 

We have described three generic model types demon- 
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FIG. 4: (a) Tree-like model setup with interference. Each 
no-back-refection beam splitter has two inputs and two out- 
puts with amplitudes t for transmitted and r for deviated 
waves (unused inputs at the beginnings and edges are not 
shown). Spins located on each edge "trace" the electron path. 
Electron can interfere due to the loops between its paths, 
(b) Equivalent representation of the model in Fig. (a). The 
one-dimensional motion with doubled spin set (before and af- 
ter scatterer). Each spin rotates by some certain angle while 
electron moves near it. All these sets are "remembered" after 
each interaction and the new set of spins in initial positions 
is "presetted" for the each next interaction. For example, if 
the electron is reflected at the first scatterer, the spin in the 
first set rotates by some certain angle before scattering and 
the equivalent spin in the second set rotates by the same an- 
gle. If the electron is transmitted through the scatterer, then 
these positions of rotated spins in the first and the second 
sets are different, (c) Entropy as a function of time r for tree 
model with interference, Z — 2, T = 0.5, and different /3. 
(d) Entropy on time r for different T = \t\ 2 and /3 = 0.9. 



strating both the monotonic entropy growth and non- 
monotonic entropy behavior. This behavior depends on 
the presence of the interference in the system and possi- 
bility of the multiple interactions with the reservoir parts. 
The entropy in the system with intrinsic interference and 
multiple interactions with the reservoir parts increases 
in average, but shows non-monotonic behavior at small 
time scales. In systems interacting with reservoir parts 
only once the entropy monotonically increases and the H- 
theorem statement remains valid. In our analysis we have 
considered quite general interaction properties omitting 
its details. Therefore, we believe the main assertions are 
valid for even wider class of models. 
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